Satellite Edge Computing With Collaborative Computation Offloading: An Intelligent Deep Deterministic Policy Gradient Approach
نویسندگان
چکیده
Enabling a satellite network with edge computing capabilities can complement the advantages further of single terrestrial and provide users full range service. Satellite is potentially indispensable technology for future satellite-terrestrial integrated networks. In this article, three-tier architecture consisting terminal–satellite–cloud proposed, where tasks be processed at three planes intersatellites cooperate to achieve on-board load balancing. Facing varying random task queues different service requirements, we formulate objective problem minimizing system energy consumption under delay resource constraints, jointly optimize offloading decision, communication, allocation variables. Moreover, distribution resources based on reservation mechanism ensure stability link reliability computation process. To adapt dynamic environment, propose an intelligent scheme deep deterministic policy gradient (DDPG) algorithm, which consists several neural networks (DNNs) output both discrete continuous Additionally, by setting selection process legal actions, simultaneous decisions locations allocating multitask concurrency realized. The simulation results show that proposed effectively reduce total ensuring completed demand, outperform benchmark algorithms.
منابع مشابه
Computation Rate Maximization for Wireless Powered Mobile-Edge Computing with Binary Computation Offloading
Finite battery lifetime and low computing capability of size-constrained wireless devices (WDs) have been longstanding performance limitations of many low-power wireless networks, e.g., wireless sensor networks (WSNs) and Internet of Things (IoT). The recent development of radio frequency (RF) based wireless power transfer (WPT) and mobile edge computing (MEC) technologies provide promising sol...
متن کاملDeep Deterministic Policy Gradient for Urban Traffic Light Control
Traffic light timing optimization is still an active line of research despite the wealth of scientific literature on the topic, and the problem remains unsolved for any non-toy scenario. One of the key issues with traffic light optimization is the large scale of the input information that is available for the controlling agent, namely all the traffic data that is continually sampled by the traf...
متن کاملDeterministic Policy Gradient Algorithms
In this paper we consider deterministic policy gradient algorithms for reinforcement learning with continuous actions. The deterministic policy gradient has a particularly appealing form: it is the expected gradient of the action-value function. This simple form means that the deterministic policy gradient can be estimated much more efficiently than the usual stochastic policy gradient. To ensu...
متن کاملPrice-Based Distributed Offloading for Mobile-Edge Computing with Computation Capacity Constraints
Mobile-edge computing (MEC) is a promising technology to enable real-time information transmission and computing by offloading computation tasks from wireless devices to network edge. In this study, we propose a price-based distributed method to manage the offloaded computation tasks from users. A Stackelberg game is formulated to model the interaction between the edge cloud and users, where th...
متن کاملDecentralized Computation Offloading and Resource Allocation in Heterogeneous Networks with Mobile Edge Computing
We consider a heterogeneous network with mobile edge computing, where a user can offload its computation to one among multiple servers. In particular, we minimize the system-wide computation overhead by jointly optimizing the individual computation decisions, transmit power of the users, and computation resource at the servers. The crux of the problem lies in the combinatorial nature of multi-u...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Internet of Things Journal
سال: 2023
ISSN: ['2372-2541', '2327-4662']
DOI: https://doi.org/10.1109/jiot.2022.3233383